Surface and volumetric three dimensional imaging methods have found application in diagnostic medical imaging and research. The acquisition, modeling, classification, and computer graphics rendering of discrete image volumes will be introduced. Applications in diagnosis (craniofacial, orthopedic, cardiovascular, and others) as well as reconstruction methods for generic serial sections will be described. C-Software for 3D reconstruction which operates on an IBM PC/AT clone is described.
INTRODUCTION
The substantial quantity of information generated by CT and MRI scanners has presented both a problem and an opportunity for clinicians. Vast quantities of data must be processed before diagnostically relevant information can be extracted. On the other hand, steady progress in the development of data reduction and visualization software has created a class of clinician-users who desire to manipulate imaging data to provide views of the data compatible with pertinent diagnostic and therapeutic needs in the management of a particular patient. For example, a radiologist may wish to apply various image enhancement techniques to better visualize small details a difficult case while a surgeon may wish to interactively manipulate the 3-D data on screen for surgical planning. The radiation oncologist may utilize CT or MRI image data in a slightly different way to facilitate true 3-D radiation therapy planning.
In each of these cases, physicians with differing requirements wish to manipulate the same 3-D data. In such situations, a workstation architecture offers an ideal solution to the problem of distributed medical imaging. Networking permits multiple users to efficiently access imaging data stored at a central location. The price/performance ratio of workstations is steadily improving, while cost per seat continues to decline. Increasingly powerful chipsets utilizing ASIC (Application-specific integrated circuits) provide powerful graphics engines for complex image processing and graphical manipulation of large quantities of 3-D data. Recently, the distinction between engineering workstations and high end PC's has blurred, and medical imaging software packages have become available for PC's at reasonable cost.
There are a number of potential advantages inherent in a workstation approach to medical imaging. The user may display and manipulate 3-D data in whatever manner is most appropriate for the task at hand. Direct interaction with the data allows the clinician to comprehend needed information in minimum time. The flexibility and power of this approach is useful not only in clinical settings but also for research and teaching. Finally, trends in both hardware and software technology ensure that the cost of workstations will decline as functionality and "user-friendliness" continue to improve, making these systems available to an ever-broadening group of users.
Image processing and computer graphics have become important software tools in the day to day practice of medicine. The use of computers in diagnosis of internal morphological abnormalities is commonplace in radiology departments. X-rays, ultrasound, radioactive drugs - inhaled or injected, and proton magnetic resonance are the physical basis of computerized medical imaging instruments, often called "scanners". Various types of scanners now exist, enabling the extraction of data in the form of images from the human body. Image processing techniques are used to acquire this raw data, reconstruct and enhance it to give the physician maximum information, and as an aid in diagnosis, treatment planning, and evaluation.
Three-dimensional (3-D) reconstruction of images has emerged as an important new tool for medical imaging(1). The original data obtained from a scanner is often a set of 2-dimensional contiguous slices (Figure 1) of the body (Figure 2). The reconstruction program takes this data set and renders a 3-D image of internal or external body surfaces. This helps physicians understand the complex 3-D anatomy present in those slices. The objective is to make the reconstruction as useful as possible for the physician. This requires the extraction of as much surface detail as possible in the 3-D image. 3-D reconstructions are used in a variety of medical applications, such as planning of craniofacial surgery(2), neurosurgery(3), and orthopedics(4).
Presently, 3-D reconstruction programs run on computed-tomographic (CT) scanner control mini-computers (DEC PDP-11 or Data General Eclipse) or on specialized computer graphics workstations. These units are more costly and are not so widely available as personal computers. We have developed 3-D surface reconstruction software for CT scans in the C language on a DEC Vaxmate personal computer, an IBM PC/AT clone. We believe that an implementation of 3-D reconstruction software on personal computers will popularize the use of these methods for CT scan data, and encourage the use of these reconstructions as a standard tool for physicians who need information on a patient's internal anatomy.
Many approaches to the computerized reconstruction of serial slice data sets have been described and implemented(1). These descriptions typically describe the implementation in obscure or incomplete fashion, and lack sufficient detail to allow the user to reproduce the work without an inordinate effort. This paper presents a limited PC implementation with a detailed description of the methods used, and availability of the source code (in the C language).
COMPUTED TOMOGRAPHY
A CT scan is an X-ray image of the body formed by computerized reconstructions. These slices can vary in thickness from 1 to 15 mm. For high resolution studies the slices are typically 2 mm thick. The pixel values of the images typically represent the average X-ray attenuation of body matter in a corresponding 1 mm x 1 mm x 2 mm cube of the body (which is called a volume element or voxel). This value is obtained by exposing the body to X-ray radiation from several directions while measuring the attenuation of the X-rays passing through the body(4). A projection in one direction is obtained with a moving X-ray source and a set of detectors. By taking all the rays that pass through one voxel in the body and using a method called filtered back-projection(5), one can accurately compute the average x-ray attenuation of that voxel. The x-ray attenuation values computed for each voxel are expressed in a scale relative to water called the Hounsfield scale(6) in honor or G. Hounsfield who (along with A. Cormack) was awarded the Nobel prize in 1979 for inventing the CT scanner. A CT scan image data set consisting of many contiguous slices is a three dimensional array of Hounsfield values (Figure 2). Each CT scan slice is a two dimensional array (Figure 1).
The slice we typically use contain 256 x 256 voxels but slice data can be 512 x 512 in size (Figure 2). The number of slices used for one patient's examination typically varies between fifty and one hundred total slices. This results in more than 5 million voxels or 10 MB of data (one voxel is two bytes) for each examination. The manipulation and interpretation of such large amounts of data is a significant problem in medical imaging.
THREE DIMENSIONAL RECONSTRUCTION
Interpretation of CT slice images requires special training and expertise, and is typically performed by a diagnostic radiologist (M.D. with special training in diagnostic medical imaging). Non-radiologist physicians and surgeons may have difficulty understanding the complex anatomy represented by these two-dimensional (2-D) images. It is often desirable to synthesize a more familiar 3-D image from a sequence of 2-D slices to aid in the interpretation and utilization of CT scan examinations
